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Abstract 

We study the SU(3) lattice gauge theory, with two flavors of sextet Wilson-clover fermions, near 
its finite-temperature phase transition. We find metastable states that have Wilson line expectation 
values whose complex phases are near ±27r/3 or ir. The true equilibrium phase at these couplings 
and temperatures has its Wilson line oriented only towards the positive real axis, in agreement 
with perturbation theory. 
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I. INTRODUCTION 



SU(iV) gauge theories with fermions in two-index color representations have attracted 
attention recently for several reasons. One is their role in technicolor theories that might be 
viable as extensions of the Standard Model [j], 0] ■ Another is the appearance of matter fields 
in two-index representations as components of orientifold equivalences [!, 0, @, @| . In connec- 
tion with the first, we have been studying the lattice SU (3) gauge theory with fermions in 
the two-index symmetric representation, which is the sextet In the course of our study 

of its phase diagram we found high-temperature states that appear to possess a Wilson line 
condensate (L) that lies along one of several directions in the complex plane, with apparent 
phase transitions among these non-confining states (see also [§, 10, [ll|, 12|)- Condensates 



of this nature are known to occur when the fermions are made to obey periodic boundary 
conditions [3, [H, 14, 15, 16], but not when the boundary conditions are antiperiodic as 



appropriate for the time direction in the finite-temperature theory [171 ] . Thus these states 
merited further study. 

A strong-coupling calculation, applicable to the low-temperature disordered phase, shows 
that sextet fermions tend to deflect the disordered Wilson line towards the negative real axis. 
If this were to persist into intermediate couplings and across the finite-temperature phase 
transition, we would obtain a condensate with a negative real part. Weak-coupling analysis, 
on the other hand, gives the effective potential for L a unique minimum with phase 9 = 0; 
nonetheless, there are local minima at 9 = ±27r/3 and at 9 = ir. Hence one could conceive 
of a global minimum appearing in one of these other directions as the coupling is made 
stronger. 

In the following, we first review the analytical weak- and strong-coupling approximations 
to the effective potential. Turning to numerical work, we show the results of simulating the 
SU(3) gauge theory with two flavors of Wilson-clover fermions, in the sextet representation, 
at intermediate couplings on a finite-temperature lattice. Quenching a disordered configura- 
tion into the high-temperature regime indeed shows that the Wilson line can condense into 
ordered states in various directions in the complex plane, depending on the gauge coupling 
/3 and hopping parameter k. The phase angle of the condensate can take values near 9 = 0, 
±27r/3, and n (the last comes of a partial disordering of the 9 = ±27r/3 states). We even 
find tunneling and coexistence among these states. In order to settle which is the true equi- 
librium state, we simulate at these values of (/3, k) from mixed initial conditions, putting 
half the initial lattice into an ordered configuration with 9 = 0. We find that in all cases, 
the Wilson line condensate comes to equilibrium in the direction 9 = 0. Thus the other 
orientations of the condensate have higher free energy and are merely metastable. 



II. DEFINITIONS 

Let us briefly review the symmetries of the pure gauge theory, their action on the Wilson 
line, and how they are broken by matter fields [l8|. We discuss the continuum SU(iV) gauge 



theory at finite temperature (3 
The Wilson line is defined as 



L(x) = ltrfi(x), (1) 
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where fi(x) is the path-ordered exponential, 

Q(pc) = Pexp 



A (x,r) dr 



(2) 



Here Ao(x, r) = Aq(x, r)X a is the gauge field in the fundamental representation; the 
gauge fields A"(x, r) satisfy periodic boundary conditions in the Euclidean time direction, 
A£(x,0) = A°(x,/3). 

The pure gauge theory is invariant under gauge transformations that are periodic up to 
a 7i(N) phase z, 

U(x,0) = zU(x,P), (3) 

where z — 1. If we denote by Q the group of strictly periodic gauge transformations, the 
complete symmetry group of the pure gauge theory is Q x Z(N). The Wilson line, invariant 
under Q, transforms as 

L(x) - zL(x). (4) 

In the low-temperature phase of the pure gauge theory, the global Z(iV) symmetry is un- 
broken and hence (L) = 0. In the high-temperature phase the symmetry is spontaneously 
broken, permitting (L) = L Q ^ 0; there are N equivalent equilibrium states, characterized 
by (L) = zL . 

A fermion field in representation R will transform as 

^(x,t)^^(x,t)^(x,t). (5) 

If U is aperiodic as in Eq. (jHJ), then Ur will be aperiodic according to 

U R (x,0) = z j U R (x,[3), (6) 

where j is the A^-ality of R. This transformation will not generally preserve the anti-periodic 
boundary conditions imposed on the fermions (unless j = 0). Thus the fermion action breaks 
the Z(N) symmetry explicitly. 



III. WEAK COUPLING 



The one-loop calculation of the effective potential is essentially a continuum calculation. 
It was carried out long ago Ijl, 20] for massless fermions; for massive fermions, which concern 



us here, see [16|. One writes 

A fl = a fl + gSA^, (7) 

where a M = (&/ (3)5^0 is a constant background field that gives a background Wilson line 
via Q = e**. We may choose a gauge where and hence Q, is diagonal. Performing the 
gaussian integration over 5A^ in background gauge, one obtains the effective potential, 



e 



= det + det^ (^7, + m) . (8) 

where Nf is the number of (degenerate) flavors in the representation R, and det± indicates 
the imposition of periodic (+) or antiperiodic (— ) boundary conditions in the Euclidean 
time direction. Calculation of the determinants gives the explicit formula 

2 2m 2 °° (— l) n 

Vex = -g^tr Li 4 (fi adj ) + JV>— y —^K 2 (nmf3) RetrQ R , (9) 

71=1 
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FIG. 1: One-loop effective potential V e s(L) for the pure SU(3) gauge theory. 



where Li 4 (;c) = ^ . x? / j A and K n (x) is the modified Bessel function of the second kind. Vl^ 
and Qr are the matrices corresponding to Eq. (j2j) in the adjoint and R representations. One 
may easily express the diagonal values of Q, fi a dj, and Qr in terms of the diagonal values of 
$ = diag(0i, 02, • • •) with <p N = — <^. Choosing R to be S, the two-index symmetric 

representation, the explicit formulas for the traces are 



L 



trfi 



adj 



— trfi 

iV iV 



v ^ 



i [(trft) 2 + trft 2 ] 
|trfi| 2 - 1 



(10) 



(ii) 



(12) 



For iV = 3, where there are only two independent angles (0i,02), all of these may be ex- 
pressed implicitly as functions of the real and imaginary parts of L, and plotted accordingly. 

The first term in Eq. involving f2 a dj, is the gluon contribution, invariant under Z(N). 
The second term, the fermion contribution, breaks Z(iV) if R has non-zero iV-ality. The 
fermion term decreases exponentially with increasing fermion mass. To show its effect, we 
plot Kff for the pure SU(3) gauge theory and for the theory with light triplet and sextet 
fermions, (3m = 0.002, in Figs. [1] and [2j The fermion term lifts the degeneracy of the 
three Z(3) states, always favoring the L = 1 state. The other Z(3) states, L = exp(±27rz/3), 
become metastable; in addition, the sextet case shows a new metastable state on the negative 
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1-0 -1.0 



FIG. 2: One-loop effective potential for the SU(3) gauge theory with very light fermions, (3m = 
0.002. The fermions are in the fundamental representation (top) and in the sextet representation 
(bottom). 

real axis of the L plane. As we will show, these metastable states survive into intermediate 
coupling. 

IV. LARGE MASS AND STRONG COUPLING 

Another view of the effect of fermions on the effective potential for Wilson lines comes 
from the large-mass limit. When the fermion mass is infinite, of course, the fermions decouple 
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and the effective potential is Z(iV)-symmetric; its minimum is either a unique minimum at 
zero or a degenerate set of minima indicating spontaneous breaking of Z(i\Q. We can ask 
which way the effective potential tilts as the fermion mass is made finite [2l], 22| . 
We consider an SU(iV) lattice gauge theory with plaquette gauge action, 

and Wilson fermions in the representation R, 

S F = $M[U]ip 

= Yl Mn -Kj2^n[(l- 7„)0^ + (1 + l,)Un-flJn-p\ • (14) 
n n/i 

On integrating out the fermions, one obtains for the partition function 

Z = J dU e- Sa[u] V)etM[U}. (15) 

When the fermions are massive one may expand in the hopping parameter k = (2m + 8) _1 
to see their effect. One obtains an effective action for the links that is a sum over closed 
paths (of length £) on the lattice, 

S cS [U] = S G [U] + J^tr 17& (16) 

t Ci 

Here Tc e is a product of (1 ±7 M ) around the path Ci, and Uq is the product of link variables 
(in representation R) around the path. A finite-temperature lattice has finite extent N t in 
the Euclidean time direction (and much larger in the spatial directions). Thus there are two 
kinds of closed path in the sum in Eq. f)16p . Those that do not wind around the periodic 
time direction contribute terms that, like Sq, are invariant under Z(iV). Those that wind k 
times contribute terms that transform as 

S Ct - z 3k S Cn (17) 

where, again, j is the iV-ality of R. This is the explicit breaking of Z(iV) by the fermions. 

Let us take for definiteness a lattice with Nt = 4. Then the first terms in the sum over 
paths in Eq. (Tl6|) are the plaquette term and the real part of the Wilson line, both in the R 
representation. The latter has the form 

SS eS = -16N f K 4 J2 RetTQ n = E y /( Ln )' ( 18 ) 

n n 

where 

f^n^w a*) 

is the product of timelike links at spatial location n. The minus sign in Eq. (TT8]) comes 
from the antiperiodic boundary condition on the fermion field, which can be implemented 
by changing the sign of (1 ± 70) on the last link of the lattice. 
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Considering again the sextet of SU(3), we note that when L is real, 



V f (L) oc -TtQs = 3L(1 - 3L). 



(20) 



Near the origin, the fermions push L in the negative direction. Compare this to fermions in 
the fundamental representation, for which Vf(L) is simply proportional to — ReL: It pushes 
L in the positive direction. 

We can illustrate this further by considering the strong-coupling limit, where we drop 
the plaquette term Sq; for simplicity, we also ignore the induced plaquette term that comes 
from the sum in Eq. (1161) . Then all that is left in the partition function, 



Examination of V e g shows immediately that the minimum is near zero, displaced up or down 
the real axis as we have stated. 

In the strong-coupling, confining phase the effective potential V e g{L) for the pure gauge 
theory has a unique minimum at zero. The addition of the Z(iV)-symmetric terms in Eq. ffTB"j) 
to the effective action will move the boundary of the confining phase but within this phase 
the minimum remains at zero (by definition). As we have seen, the addition of the Z(N)- 
breaking term Eq. (Tl8|) does move the minimum. If the fermions are color triplets, the 
minimum is pushed up the real axis. It is possible that as the lattice coupling is weakened 
the minimum moves continuously towards L = 1, which is its weak-coupling destination. 
In this case there is a continuous crossover between confining and non-confining regimes. 
This is indeed what is seen for light quark masses, while for heavy quarks the transition is 
first-order. 

Color sextet fermions, on the other hand, push the minimum of V e s in the negative 
direction. This makes it more likely that a barrier between this minimum and that at 
L ~ 1 persists in the transition region and makes the transition strongly first-order. This 
is consistent with the results of Ref. |8|, where a strong transition was found for all quark 
masses. 

V. INTERMEDIATE COUPLING: MORE PHASES? 

We have found two differences in the effective action V e s(L) created by triplet and sextet 
fermions. In weak coupling, sextet fermions create an effective potential with a complex 
shape, admitting additional metastable states. In strong coupling with large masses, the 
sextet fermions push L in the negative real direction. This raises the possibility that the 
condensate in the intermediate coupling region might condense in directions other than the 
positive real axis. This indeed seemed to be the case in our earlier study jl] . In this section 
we will show results that indicate that while new states may be reached in a quench from 
the disordered strong-coupling phase, these states are not equilibrium states. They can be 
made to decay to the true vacuum, which has a positive, real condensate (L). 





is the measure and the local potential Vf(L). The effective potential is then 




(22) 
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FIG. 3: Results of quenching from a disordered state. Symbols indicate the orientation of the 
Wilson line condensate (L) following a quench from a disordered configuration. The dashed line is 
the boundary between equilibrium phases — disordered vs. 9 ~ — determined with mixed starting 
configurations. The last symbol in the legend marks a (/?, k) value where two different states were 
reached in two runs: a state with tunneling between 6 ~ ±27r/3 and 9 ~ 7r, and a state with 9 ~ 0. 



Following the method of |8[], we simulated the SU(3) gauge theory with Nf = 2 flavors 
of sextet fermions. The action is a plaquette gauge action with Wilson-clover fermions; our 
program, derived from the MILC code, uses the hybrid Monte Carlo algorithm. We worked 
with 8 3 x 4 lattices with couplings chosen to frame the finite-temperature phase boundary: 
5.25 < (3 < 5.6 and 0.145 < k < 0.155. In Ref. Q we found that n c was between 0.164 
and 0.169 in this range. There we determined the tadpole coefficient uq self-consistently for 
each value of (3 at k c ((3), reaching values between 0.881 and 0.889; here we set u = 0.887 
throughout for simplicity. 

Quenching from a strong-coupling state creates an intricate "phase diagram," shown in 
Fig. [31 There appear to be four weak-coupling states, distinguished by the direction that 
the condensate (L) takes in the complex plane: 

1. (L) real and positive (phase angle 9 ~ 0); 

2. (L) condensed in the direction 9 ~ +27r/3; 

3. (L) condensed in the direction 9 w —2%/3; 

4. (L) real and negative (9 ~ 7r). 

The two states characterized by 9 ~ ±27r/3 are related by charge conjugation C and they 
exhibit spontaneous breaking of C. They are approximately related to the 9 w state by 
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FIG. 4: Quench from disordered state to 9 « in the weak-coupling phase. 



the (explicitly broken) Z(3) symmetry, while the state with 9 « tt is not. We find that (L) 
in the 6* ~ 7r state is close in value to Re (L) in nearby ~ ±27r/3 states, which leads us 
to conclude that the 9 « 7r state is an Ising-like disordering of the ~ ±27r/3 states that 
restores C symmetry. 

We show in Figs. HHH] some histories of the quench to the various states. Especially 
interesting are histories that show tunneling among the different weak-coupling states. These 
are marked as coexistence points on the phase diagram. We also found at least one point 
where different final states emerged in different runs from the same start. (We did not search 
for this phenomenon systematically.) 

It is quite curious that the phase diagram shows such a complex interleaving of the weak- 
coupling states. It is even more curious that the right-hand edge of the phase diagram 
exhibits all three states, even though weak-coupling analysis shows that only the 9 = state 
is stable in the limit. These features raise the suspicion that we are dealing with metastable 
states. A simple test proves that this is so. Choosing a pair of adjacent couplings with 
different states indicated in the diagram, we can take a configuration from one coupling as 
an initial configuration for simulation at the other. Almost any pair so chosen gives very 
large hysteresis, an almost complete failure to tunnel into the putative equilibrium state. 

We settled the issue by the simple expedient of using mixed starting configurations. For 
each (J3, k) where the quench resulted in 9 96 0, we created a starting configuration by filling 
half the lattice with the field configuration coming from the quench and the other half with 
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FIG. 5: Quench from disordered state to ~ at stronger coupling than in Fig. [H In this case 
the true equilibrium state turns out to be disordered. The large value of (\L\) in the metastable 
state indicates that the phase boundary is first-order. 



a 9 ~ configuration from a nearby coupling. 1 The result was that every simulation in 
the ordered phase ended up in a 9 = state (see Fig. [9]). This procedure also established 
with confidence the location of the true boundary between the disordered and the ordered 
phases, as shown in Fig. El 



VI. SUMMARY 

Weak coupling analysis shows that the SU(3) gauge theory with sextet fermions possesses 
metastable ordered states with 9 m ±27r/3, which break C symmetry, and a state with 9 ~ tt. 
A hopping-parameter expansion shows that these fermions pull the Wilson line condensate 
(L) towards the negative real axis; thus the disordered phase tends towards 9 = it as well. It 
is thus not unreasonable to suppose that near the phase transition, the ordered phase might 
fall into an orientation other than 9^0, possibly breaking C symmetry. Our numerical 
work displayed all these ordered states, but indicates that the only stable state (in the region 
we examined) is 9 m 0, agreeing with the weak coupling limit. 

The deflection of the disordered phase towards 9 = it indicates that there is a barrier in 



We also ran such checks on the 6 w states near the confinement phase boundary. 
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FIG. 6: Quench from disordered state to 6 pa 2tt/2> in the weak-coupling phase. 



the Landau effective potential separating this minimum from the weak-coupling minimum. 
This argues for a first-order transition as the two phases compete, rather than the smooth 
crossover seen in QCD with light triplet quarks. 

We emphasize that we have examined here the gauge theory at physical finite temper- 
ature, that is, with anti-periodic boundary conditions in Euclidean time for the fermions. 
Our results should not be confused with those for periodic boundary conditions, that is, for 
two-index fermions in a finite box. The latter indeed show an equilibrium condensate in 
directions other than 9 ~ 0, with the possibility of spontaneous breaking of C symmetry. 
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